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INTRODUCTION. 


There arc various'brands of computer networks. The present paper is only 
concerned with the type of general purpose heterogeneous computer network of 
which Arpanet is 2 typical prototype. In this field experience is scarce, since 
iio network has yet progressed beyond 2 n initial experimental stage, while most 
are still in a planning or construction phase. Consequently, applications and 
user needs can only be thought of introspective terms. Organizational and 
sociological issues hiding underneath the concept of network may be of such 
magnitude that many years will elapse before we can record any significant 
breakthrough. 


In the present stage major efforts bear on technical issues, with the objective 
of developing and mastering the network technology. We have to recognize that 
proposed structures and techniques have yet to be validated from experience, and 
that various other approaches might as well be. considered. It would be nice if 
we. had practical evidence that present views are justified by economics and user 
acceptance. But assessing networks on today's applications is not necessarily a 
sounder 'standpoint. • . 




II “ COMPUTER NETWORK CHARACTERISTICS 


1 A'" lie. L'rro pc 1 neons i nsl nl Inti ons 

Networks of computers may bo. homogeneous. But this is the exception rather.than 
tlic- -rule . Come ••organizations , it kc IBM, Control • Da ta., University Compu t i hg Co.,, 
j etc... have set up computer networks, to provide specific services, using the 
same brand of machines and operating systems. Sooner or .later a new generation 
comes by. and must be inserted. Replacing a whole network with new systems in a 
■sb'ort span of time is quite unrealistic. Thus, homogeneous networks are bound to 
turn heterogeneous, or d.ie out. , • 

Most computer networks cannot afford to be homogeneous in the first place. They 
have to start out with e xisting installations , which happen to be a mixture of 
every computer system on the market. But this is a reasonable constraint, as it 
forces to design network mechanisms for the general case, which makes them more 
suitable to accomodate future extensions. (Tig. 1) 


As' a result of this heterogeneity, there is no common interface , or procedure to 
interchange data .. Ac tunl. ly , this is not a direct implication of having hetero¬ 
geneous computer systems. Indeed, there might exist some generally agreed methods 
to govern data exchange between various computers. But thi's is not so. Every 
manufacturer is still entrenched in its closed world of idiosynchrasies ,■ and must 
devote a great deal of effort only to have its own machines to communicate. 


Installations are. not just heterogeneous in terms of computers, but also in terms 


of management , act 


.v: 


,es , 


;ts, 


1 , , 


. s 


md there is no magic receipc to 


turn them into a strong unified body, Being part of a network should not mean 
losing autonomy and decision freedom. They want to retain all their capabilities 
to run their own business as they please. Local peculiarities arc to be expected 
'as a matter of course, and operation of the ’whole network should be made 
independent of local installation behavior. 


As in any association, federation, or business, some members tend to cluster in 
sub-groups, or clubs, based on some common ties not shared by others. In a . ■ 
computer network, clubs may be made of users of the same system, service bureaus, 
bankers, installations of a corporation. Presumably, most of the traffic generated 
by members of a club will be exchanged with other members.'Conventions about 
information interchange may well be tailored to some particular dominant type of 
transactions peculiar to the club. (Fig. 2) 


On the other.hand, members of a club will want occasionally to have’some exchange 
with members of another club. They may even belong simultaneously to different 
clubs, Although a club sounds initially as a closed group, it should not be that 
closed after all. Some excursions should be pos-sible toward' foreign installations, 
just in ease. In fact, installations belong to what we may call semi-closed groups . 


B - Data communications svstem 


The challenge in designing a communications’system for a computer network is that 
only quelifa tivc aspects may be guessed. No figures arc available, since computer 
networks do not exist. Or at least they have not yet emerged out of the initial 
.building up stage. What we may assume is that there will be computers and terminals, 
and some barely predictable, amount of data traffic between them. Presumably, the 
amount of traffic will, be related to the. capability of those devices to generate 
or accept, data. In other words, compu ter-to-compu ter traffic, high speed, and low 
speed t e rminal s will likely fall wi thin di.sli.net eatego r i es of traffic, patterns . 







Then-fore, the communications r.ystc-in will have to meet simultaneous! y a mixture, 
of requirements pertaining to different clancc: s ol data interchange . (I' i p;. 3) 

Thi!; comets in addition to carrying dominant flows, depending on the geographical 
topology of installation clubs. 

Since .the communications system should cater for an unlimited number of computer 
. makes> .be suitable for semi-private traffic, and work in an environment of loosely 
related installations, it cannot depend on any of them. In a context of mutually 
suspicious parties, thecommunicotions system will be deemed at fault, unless it 
has proven very reliable . 

Furthermoro, it should ,carry, within some limits, a somewhat unpredictable traffic' 
ranging from low speed 'conversational messages, up to bursty high speed proccss- 
Lo-proccss interplay. New installations may be added, others can be discontinued. 
Since the number and type of applications using the network is a priori evolu¬ 
tionary, there cannot be any favorite characteristics tailored to some specific 
traffic. Although some requirements may turn out to be contradictory, the 
communications system has to walk a thin line, and comply efficiently with a 
diversity of traffic patterns. This is called flexibility , in a subjective sense, 
as opposed to rigidity. • • * . • 

Carrying data between heterogeneous computers of'terminals, including all sorts 
of private or semi-public conventions, would end up in a Penelope web. type of 
task, if the communications system had to get involved in' data codes, formats, 
procedures, etc... Adding constantly new features, fixing old ones, would not 
make for a reliable system, and installations .would resent being tied with not 
•quite satisfactory network options. A better approach is to make the communica- 
.tions system data transparent, in order to accomodate any type of-code or 
convention that instailations might want to use. (Fig. k) . • 

Once a network starts operating, it becomes very frustrating for users to disrupt 
its working. Particularly, if they have built a substantial investment in 
software and organisational structures. A most appreciated virtue of a communi¬ 
cations systems is to provide for abiding service, so that long term planning be • 
carried out, counting upon well defined network characteristics. Communications 
are akin to a public service. Changing components of the. communications system ' 
should not have any visible impact, other than improvement, on the way installa¬ 
tions exchange data. Requiring all users to adapt their programs overnight would 
verge on sheer upheaval. • • ' . 

The previous considerations converge towards opting for a communications systems 
as independent as possible, from installations or terminals which it is to serve. 

On this way, both users and communications system can protect their investment, 
and bo free to introduce whatever gadget they like, as long as they keep the.same 
conventions to talk to each other. ■ .. 

C - basic structure . - ' ■ . 

As already exemplified in Arpanet, the resulting structure of a'computer network' 
is two- !e ve 1 . A first level is the communications network, in charge of carrying 
messages between computers. A second level is the set of computers, concentrators, 
-terminals, which use the communications system as a black box. (See e.g. 

Pr Dadda’s paper) 

"Ideally, the. communications system should he so transparent that installations 
would not even notice it is there. In other words, installations are not concerned 
primarily with, exchanging me.ssagcs with some communications medium. They would 
like to send and receive data as if they were in direct connection with other 
installations. Hut we have seen previous]) 1 that installations arc heterogeneous, 
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■n.'u! do hio t have any common convention to exchange da ta. A sol u L'i on would be to 
force every one of them to adapt to a network standard. This mi f.ht be rcasonabl'e 
if each a. standard were or i(; in.at in;; from .a distinguished bod.y, like ISO, or CC.ITT, 
or the U.S. Kavy. Otherwise, one can expect most computer manufacturers being up 
in arms, as there is nothing, they loathe so much as users putting on their machines 
some exotic piece of ’Hardware or operating system. 


A more attractive approach consists in putting some 'haterface adapter in the 
eommni ca t io'nr. system, so th.al^no modification be required from individual' 
installations.' This is acceptable, since data speeds arc standardized by CC'ITT," 
and transmission procedures can be limited to those of a half dozen major 
manufacturers, while others can be talked into adapting their software. (Fig- 5) 


■Nevertheless’, procedure's may change with a new system release, and new' ones are 
put forth over the years. Thus, it is typically the kind of function that should 
be made modular and optional, so that the rest of the communications system be 


kept well insulated from p: 
a pluggable micro-program. 


icedure updating. Before long 
(Some machines already have t 


it will be located 
his' feature) . 


rn 


We have seen above that installations may occasionally interfere with members' of 
different clubs, and that some private conventions, as opposed to manufacturer’s, 
might be used in the context of specific applications. Thus, a single installation 
may wish to use a few different options, according to its type of work. This is 
quite feasible if it has several links with the communications system, or if.it 
can direct messages toward appropriate adapters according to a message type, 
(software link). Logically this results in the communications system seeing 
several- virtual installations mapped onto the same physical one. (Fig. 6) 


A bare communications service may be unsuffie 
may wish-to have .more sophisticated options, 
information retrieval, traffic hack-up in cas 
■format conversion, and what have you. There r 
of services that may be offered, grafted on in: 
where experience and an imaginative marketing 
interesting business. At first sight, this se 
desirable characteristics of a communications 
reliability, while said services would smack 
its all too familiar lack of testing, specifi 


em 

s 

r.o 


nt for tome installations. They 
ke long term storage of data, 
of installation outage, code and 
obviously no limit as to the type 
rmsti on transfer . It is an area 
pproach can result in many an 
in contradiction with the 
ystem long term stability, high 
re of a commercial product with 
tion changes, quick obsolescence. 


These opposite objectives may be reconciled through an appropriate system design. 
Anything not directly relevant to data communications purposes should be left out 
of the communications system. On the other har.c, desirable add-on functions can 
be implemented by specific installations considered as some!',on 7 embedded within 
the communications system, as seen from external users, while they would actually 
be logically independent, as any other external installation. For all practical 
purpose; their junction with the communications system would be no different 
whatsoever. (l’ig. 7) 


On the previous chart, wc have represented some "internal" installations, But there 
is no intrisic technical difference between internal and external, as far as the 
'Communications system is concerned. The distinction is intended to stress such 
cons id cr a t ion s as guarantee of service, tariff structure maintenance, and the 
like. But there is a continuum ranging from a public service, to a non-profit 
agency, to a service bureau, to an organization offering services as by-products. 
The decision as to which services should be offered from within or from outside is 
mainly commercial or political. One can even switch status, without interference 
in communications techniques. ■ . 












It; certainly could be read ns a m i r a c I c If every component o f a comniun i cations 
system would belong to a cl i f f a von t orga n i zn t ion , and if the service ware 
satisfactory wi t.h no one. responsible for it. Myriad r.' of operational problems 
require a well. defined i'e r pon sib i. 1 i ty verted in an or pan i /.a t i oiv we may call the 
Network Authority. It. i.r; not necessarily die owner of every piece of equipment, 
hut it;' is assigned the mission of seeing- to it that the whole- system works 
properly; The extent of this - mission may vary :.typically it. would cover the 
foil ovine areas : 

1. Maintenance : _ . 

Namely error tracing and repairing. This is a tricky task, as it involves 
equipment from various suppliers, including lines leased from common 
carriers. And it is positively undesirable to. bring the - communications 
system to a complete halt, just to find out which component needs fixing 
up. Intervent ions must be done on a live system, with appropriate care. 

2. Accounting : • - 

Exchanging data costs money. Again, it would not be very satisfactory to 
rely-upon individual installations to declare the amount of traffic they 
have been gene-rating. On the other hand,, the. Network Authority is in a good 
position to.record traffic figures suitable for later accounting and 
billing. • . • „ •' : 

3. 'Traffic, analysis : . . , 

Coiisiiuni c-al A-ns networks are far from being completely understood. From 
mathematical theories to practical eases, numerous studies arc presently 
being pursued. In - order to validate or feed in models, traffic patterns 
must be recorded and sorted out. Furthermore, due to the individual 
freedom of j e..f allations, traffic patterns may change, rapidly. A 
continuous analysis is necessary to anticipate in due time configuration 
changes and tune the system to its actual requirements. 

4. Development : . . 

It is an obvious extension of the responsibility for maintenance and 
traffic analysis. Dcvcloppemcnt is probably best assured by the organi- 
•zation which has the best knowledge on. inner workings of th.c system.- 

5. Clearinghouse : ' . ' 

'independent from the cost of communications, installations provide services 
■ to one another, which is liable to some cross-billing. Rather than having 
each one to send invoices to every other, it is more convenient to 
consolidate all accounting in a single location, and apportion each one's 
balance sheet to its total activity. All the more that some tariffs may 
be tied with the -amount of traffic exchanged between installations. 

Although the Network Authority is not the only place in a position to 
perform this task, putting it there is probably more convenient. 

, ' '6. Network control center : . 

Most tasks entrusted to' the Network Authority cannot bo. accomplished 
' . without computerized aid, such ns running diagnostics tests, monitoring 
traffic, cross-billing, etc.,. For that purpose a computer installation 
is needed, and it can be linked to the communications system on the same 
. basis as'any other installation of the network. Owing to its obvious 
. . prun'd eges, this installation can be considered as "internal", in the 
cense used previously. 







E - Info mint ion centers 


The diversity and the geographical distribution of resources in a computer 
network create the'need for various information rcpositoric 
network sociology, rather than technology. Indeed, like in, 

conducting business, some medic arc needed to facilitate an encounter 'between 


. This belongs to 
ny association 


ads, news, manuals, indexes, mail 
point in the future t-he video- 
place- over networks, and be canned 
ter .is. developing in Arpanet at 
might be provided by the Network 
Authority, 'but other specialized installations may do it as well. Ideally, it 
should be thought of as set of coordinated interactions between installations, 
and again some dominant patterns are, likely to match the part it ionning into 
clubs. (Fig. 8) 


supply and demand. This can take the form o 
service, broadcast, etc... Probably, at some 
technology wi.J.i allow live meetings to take 
in play-back files. An example of such a ce 
Stanford Research Lab. Some of these services 
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CONCEPTS AND FUNCTIONS 



A - Da(: a aw 


. tch: ng 


and:i nc 


.’Various 'techhiviucs may bo considered when it conics 
.system between’computers'. What they have in common 
government regulated monopoly, and they require 
fncilit j .--s'Developing a specif i e one is perhaps not 
initial cost would be unacceptable, unless intense 
a period of war. . . 


to set up some communications 
is that they must comply withcome" 
ex i s tn g commu n i c a t ions 
to be ruled out, but the 
pressure is put' on, 'like in 


If is not the intent of this paper to discuss communications techniques. Let us 
remark only that computer input-output is message oriented, in digital form, and 


that existing communications facilities 
.than data communications, (voice, teleg 
technique called "packet switching" has 
Nr'. Davie 


have been engineered for something else 
a ms , television). More, recently a 
been proposed and experimented, (see 
the best out of existing technologies, and 
ellitc transmission. Observing 


paper)...It seems to mak 
it: can be supported by telephone, radio, or 
the trend in networks show.; that transmission systems evolve towards a message 
store' and forward technique with short messages, and short transit time, in 
order to meet the requirements of conversational traffic. With mini-computers 
and the availability of high speed lines, it looks as if the day of packet 
switching has come, at least for a decade, till new transmission .systems are 
widely offered. In the following, assumptions made about communications systems 
will be restricted to packet switching-. 


As vc have seen before, we want a communications system independent and 
insulated from''computer installations. Consequently, a packet switching system 
has to be a compute r network in i.ts own right, but a highly specialized one. 
What it has to do is to switch short messages (packets) on the best possible 
way, i'.e. fast, efficient, reliable. Cf course, each of these adjectives might 
take pages of discussion. Since every other additional service is to be imple¬ 
mented in some internal or external installation, the communications network-- 
should do no more than packet switching. Externally it looks like a black box 
to which messages are handed for delivery to a specified destination. (Fig. 9) 


The internal, structure of a communications network could be looked at. 
conventionally as reflecting its physical structure, i.e. a sot of computers 
exchanging messages, to carry either data or control information. There is 
nothing invalid in such a model. But some concepts, in addition to represent a 
physical structure, have also the power to expand and generalize the model in 
a way that brings new light, sets guidelines, and eventually helps re-thinking 
tiro structure itself. Considered as a black box, a communications network can be 
viewed as an abstract machine, which as,usual has an instruction code, 

Fa s s ir. 

:n 


processors, 1 


0 , 


md internal states 


lilioccs sor. (node) is tantamount to inputting 


a message over to a communications 
instruction (op. code -i- operand).- 


Executing the instruction is in affect transferring the message into another 
component of the machine, and output it. In a shovt-luind form this could road 


' input A ......... -input message 

B., : = R(A) ....... 'evaluate destination 

(B) :^ (A) ...... transfer message to destination 

’■ output B .output: message 






I 7 . 


c 



F i »lire 9 . 




Some: instruction. 1 ; 


may spawn several output: 
or i’f some options arc exorcised, like, 
arc mainly used for interna 


if they hail (c.g. k(A) undefined)., 
ms Tor path 
:oni t o r i n 53 , 


tracing the transfer path'. Internal states 
1 control of the machine (m 


n re mainiy usee ; or inteinaj. control or tne macni.ne (.noratonre, naj.ntciiancc 
as a result of failure diagnosis. Other instructions'may act upon internal s 
winch can bo. thought of as switches, special registers, or panel lights, in 


maintenance) or 

states , 
a 


conventional computer 


Describing, a.-compiuni cn tions network ns an abstract machine is a . way to’ draw a 
line between its functional specifications, as visible from an external user, and 
its physical implementation. Of cour.sc, it wpuld be non~ncnsc. for a designer'not 
to have precise ideas nhnnt the mechanisms -underneath, hut as far as possible, 
.inner workings should be kept■invisible at the functional level, because computer • 
'installations on one hand, and the communications network on the other hand 
should conserve, maximum autonomy. 


Opening the black box discloses a new dimension, . (Fig. 10). Our abstract 
machine is actually composed of a set of components, say processors, which must 
be put to work in a coordinated fashion to get a message through. In other words, 
executing an instruction of the global.machine is a multi-processor action. Then 
it might seem that well known process coordination techniques would apply nicely. 
Actually they don't. Although we arc dealing with an abstract model,, we are 
nevertheless, in a real world. There is no common store, no indivisible operation, 
r.o well-mannered processes. Components are geographi cally - scattered •> and they 
may fail. In this machine there is a communications problem between its own 
components. We are facing a more general case of mu 1 1 i-proc e s s or, 1. e. a dis t ribut ed 
'machine. • 


Father than attempting to devise a complex model of a distributed machine, an 
easier and more powerful approach consists in breaking it down into simpler 
components along its geographical distribution. Each node is again a local 
ma chine , v’hethcr it he uni or multi-processor'. Its abstract model is identical 
to the global one, with an instruction code, 1-0, etc... Messages arc. instructions 
as previously. Executing an instruction of the global machine appears now 7 as a 
sequence of instructions on local machines. Each one performs a step of the 
global instruction, and outputs a result towards a neighbor machine. The process ■ 
propagates up to a point v.’hcre output is directed to the. external world, and 
there it stops. (Fig. 11) 


Actually this process can be other than 
Indeed, components may fail, particular! 
instruction may bo 'repeated a number of 
internal states may change. Thus', output 
the set of local instructions becomes a 
in parallel. In the end there may bo one 
that some error control scheme is needed 


a sequence of local machine instructions, 
y the communications lines, and a local 
times, v;ith different results, because 
s may be sent to various neighbors, and 
tree, with loops and branches executing 
, none,' or several results. It is clear 
to make cur machine reliable. 


This global instruction moving step by step through successive local machines is 
reminiscent of the pipe-line structure of high speed processors, or time-slotted 
multi-processors (CUC GOOD peripheral processors). The similarity is not acci- • 
dental. With very fast and cheap-micro-components, future machines will contain 
hundreds or thousands of processors. They will be micro-networks. 


As seen previously, the local machine model is the same as the global machine. 

Our s true tur e_i s recursive . But only one level of recursion is not .much after all. 

Let. us can y Lius approach one step further, by applying the distribution concept 










•to, l ho i ns t I'ucnon com-. .1 .. .,, ^ . , . .. .. 

due to the minibcv of bit;; reserved Tor the op. code. In our network machine we 
can consider that each instruction type is executed by a logical component, 
loca-ted somewhere in the global machine. An op. code is then simply the address 
of the appropriate instruction processor. Executing a global instruction in a 
first phase propagates it toward its specific processor, where it is executed' 
with possible further propagation, liy putting logical network components 
within the des tination name space , the instruction set can be as large as 
desirable without practical iimiLs. In other words, the hi ns truer ion set is 
olien-e nded ■ This .is a nice feature for an experimental, system.’ The network ’ 
machine is now defined in terms of logical (software) components, instead of, 
local (hardware) machines. Practically these components have to be physically 
located within some or all nodes. Consequently, the same structure applies as 
veil to a local machine' (node). (Fig. 12) 

A consequence of this regular structure is that communications between logical 
components -(software machines) is the same whether they be geographically distant 
or located within the■same node. But there is a difference in delay. 

Another consequence is that several networks of that type c.an be put together 
and make up a single network. This is the recursive structure property applied 
outwards. Indeed, every network c.an be modeled as a node, hence several networks 
are a network. Part'itionning and coalescence of networks may occur during normal 
operation as a result of line failures. Tlv reforc this sort of self~ada pting 
structure is most 'desirable, as it saves on down-time -and service disturbance. 


B - Hosts • 

Go far we have used the term "installation" to mean vaguely a computer of the 
set making up a heterogeneous general-purpose computer network. This requires 
further attention, as we know that computers can reveal various metamorphoses. 

Since the Arpanet literature introduced the term "host", it has been used 
v.’idely, although not always in the very same sense as Arpanet. For the sake of 
’consistency, we use it here also, in some loose sense, as we shall see.' 

As seen from the communications nctv:ork, a host is a sourc e and a sink of mess ages. 
It is able to input and output messages of a predefined format, and it has an 
address, i.e. it is known, within the name space of the communications network. 

This is enough, but one can notice that not t he ‘si igh.tcs t assumption is made 
about the logical or physical nature of a host. This means that the structure 
of a compute]' network is totally independent of that of a properly designed' 
communications network. 

4 

At the ho st level, discounting some special eases, no one'is' interested in a 
computer per sc, because it is not a usable logical entity. Usable entities in 
n computer are resources : files, processors, peripherals, user accounts, etc ... 

]'n order to get some productive work, activities are run to which a sub-set of 
resources arc assigned, exclusively or in some shared mode. Customarily, computers 
arc: used in a multiplexed fashion, allowing several activities in parallel. Thus 
a host is merely a container of resources and activities. 

_Tn a computer network environment, useful host-host communications actually occur, 
between activities, in order to access remote resources, or set up distributed 
a c t i v i t i o s. Due to the heterogeneity of the. hosts, there is no c.mr.on or compa¬ 
tible definition for n local activity. On the other hand, c.onmu: at ions between 
hosts cannot take place unless some mutual agreement has been a;-.. . ed upon. To get 
around this dilemma, we introduce a new kind of network-wide entity called a 
subsenv her. They a. re purely abstract things, bearing a name: known by every lvost, 
which activities can plug into when they want to .start -.some host-host communications 
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In in,-my ways subscribers arc like phone set:; , (kip,. 13) 

The number of subscribers per host should be large enough to accomodate the needs 
i of simultaneous network activities. Dut if we want to avoid intricacies and 
inconvenience associated with a' dynamic assignment, subscriber names should be 
assigned permanently to real 'world entities such as users, terminals, services, 
etc .... • ■ 


Usually, all' messages exchanged between a host and the communications -network, are 
multiplexed onto the same transmission lines, typically two for reliability. Thus 
a logical component is necessary to- collect and deliver messages 'fro and to the 
proper subscribers. It is typically a host operating system module, of the access' 
method species, implementing "the" network pro toco 1. ' • 


however, a unique protocol is quite constraining. New versions must be tried out 
occasionally, user clubs want their own protocol, an .experiment is contemplated 
with a host in a different network, and for a handful of other good reasons, a 
host should accomodate var i ous protocols , which may or may not be compatible-. 
This results in a more ‘ sophi stica ted .structure with two levels of multiplexing, 
one for protocols, one for subscribers. . ‘ 


'If messages recei.vcd by a host must be fanned out to the proper protocol, this 
means that some general convention has been agreed among all protocols -about the 
selection algorithm.. This would not be too realistic, as protocols may just happen 
independently, and it would be in contradiction with the concern for installation 
freedom. Consequently, we use a different scheme.- Within n host there can be 
several virtual hosts , each one with its own set of consistent protocols. 
Incompatible protocols are in as many virtual .hosts, for which there arc different 
addresser, in the name, sp-Tce of the common i c.a t ions network. Thus, messages are 
dispatched according to their virtual host destination within a single host. 

(Fig. 14). This technique applies as well when a host is composed of several- 
.computers hooked together, or when a host is operating under a virtualizing 
^system like CP-67. 

So far there lias been no assumption about the number of transmission lines used 
to connect a host to the communications network. It has only been mentionned that 
two would be appropriate for reliability.-It is not said cither that they should 
go to the same node. For reliability it is better to connect to different nodes, 
but this is immaterial as far as the host is concerned'. However, it matters to 
have several lines, particularly if-the host is a -di s tvi but cd system, i.e,. a 
network. In this case it is very likely that several paths- should be established 
between both networks. 


To recap, it appears that the concepts of host and subscriber are flexible enough 
to elude any precise definition, except being names. Practically they can be 
associated with a variety of objects. Let us say that a host is a container and 
a supplier of resources, while a subscriber is usually a set of resources 
intended for an activity. E.g. a subscriber can be a file, a terminal, a user,' a 
sequential process, a sub-systc.m, an operating-system, a virtual machine, etc... 
"Some entities might as well be considered hosts or subscribers, depending on 
convcniencc. „ . ■ . • 
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Figure 1 A 




Using d i s tan L resources , communicating w i L h distant: processes require naming . • 
them, But since hosts arc heterogeneous, tlierc is no consistent scheme to name 
distant resources. Furthermore existing names may conflict. A first attempt to 
.circumvent the problem is to define a new name space global to .all hosts. This 
may be the case for subscriber' names. Thc.raftcr, every’host organir.es on its 
own way a mnpping of -its local names onto, the part of the global name space 
■allocated to it. But this means that:-one must know beforehand how .a distant host 
maps its' local'-names 'in order - to- access' its resources. Again,' this is hetcrogc- ■ 
ncou s. . ' ' ' 

A second technique is to use a hie rar chical ..name space. Names are. 2-conponcn t, 
one is a global name (host, subscriber, or any other), the other is the local 
name designating a specific resource in the host naming scheme. This method is 
■usually more costly for computers, but more convenient for human handling. 

There is a dilemma, in networks when it comes to locate an entity from its name. 
Due to delays inherent in communications, it is costly to search for a name in 
several or even all hosts. Consequently one tends to make up names with a host 
name component, .which serves as a geographical pointer. But this scheme is not 
well suited to resources which belong to virtual or distributed host’s. There is 
more flexibility, if resource names are independent of host names. But to reduce, 
.search’time it is-desirable to reinstate a geographical locator, which we may 
call a region name. _ . 

Regions can be defined with the objective of cutting through a minimum traffic, 
so that region and traffic clusters would r.oughly match. In addition, within 
■the confines of a particular region there is no need to use global names, since 
the region name can be implicit. Both'effects would compound to make most names 
shorter ,. hence more convenient. 

Other more .sophisticated variations may be considered, in order to simplify 
naming across the network. They are inspired from- dialing schemes in the 
telephone system,, which are. quite interesting indeed. See a phone directory for 
mo rc d et ai1s . ■ 

D - Communicating entities . 

In a message oriented communications network sending individual messages is a 
basic capability which docs not require any initial set-up. This can be put to 
an advantage in a computer network when cooperating activities exchange short' 
sclf-iden 11 f v ing messages, e.g. transactions, samplings, control information. In 
this case, the only entities required at host-level for activities, to communicate 
are subscribers. Once an activity has a subscriber name assigned to it, it can 
just send messages to any other subscriber in the network, under the same protocol 

Buf'morc traditionally, interchanges between activities tend to be modeled after 
sequential 1-0. It is a transposition at network level of programming systems^ 
designed for sequential devices. In effect most inter-process communication 
schemes arc data stream oriented-, stemming from an I-Q-mi.ndcd approach. Thus it 
is convenient to have mechanisms at host level geared to data stream handling. 

For that purpose new kinds of entities are required, to provide something like 
da ta pi pcs between activities. There arc a number of possible variations in the 
functional design of such tools’. Also the terminology is not stabilized. In the' 
following wc designate by pipc such an entity capable of channeling a data stream 
'between two distant activities, and ports the names used at each end by host 
activities. Here are some typical pipe properties which may be encountered. 



.Since a data aLrc.iia always requires some; feedback for error 
it is most convenient to , have bi-directional pipes. 


. ow cc 


. balf_-_or fup ~dui>l_cx : * 

On bi-directional pipes full-duplex mode is much more simple and efficient, as 
- it does away with the contention problem that plagues-half-duplex procedures. 


. Sequential : ’ • • ‘ 

This.is the property of delivering messages in the same order as they arc put 
into. For sequential data streams, sequencing is mandatory. But.a pipe may be 
used by a .rub-system p.-hi rh contains its own scheme for tagging 'and controlling 
the message flow, in which ease sequencing is not necessary. 

IrA r0 I_ c 2I)!:I 0 ^ : • ‘ 

It is the ability to insure that every message sent has been received only once. 
It can be a by-product of sequencing. It is not questioned that error control 
is needed at some point when data travel from host to host. But where to put it 
'..is.an issue far from settled. There is more elaboration on that in the following 


■ Pl21i_ c 2 r '‘P:-2^ •' 

■ It is a mechanism whereby the receiver can choke up the sender to prevent 
over flooding. Same comments as for error control.' 


. Parameters : ... 

To regulate the data flov; and tunc it to the amount of resources, available to 
both sender and receiver, it may .he appropriate to associate parameters such 
as : message length (mini. + maxi.), traffic rate, time-outs, etc... These 
parameters can be negotiated between both parties as part of the pipe initial 
•• set up. '• 

It should be emphasized that pipes are only a construction implemented at host 
level. In some cases they are. ■ extended end to end through the communications 
network. The implication is a strong coupling between the design of host protocols 
and communications network. This may be justified for specific applications (c.g. 
Tymnet, a service bureau time sharing netv.’ork), but in the general case, this is 
in contradiction with our principles of insulating the two domains, due to the 
undesirable constraints attached. • • • 

Data pipes are to be set up,(opened) and destroyed (clo5;cd) at the request of 
host activities. As one can figure out easily, it would be a tricky problem if 
both activities had to agree on a common pipe name, because there 'is no referee 
to break a tic up. It is more convenient to name a pipe from both ends with local 
names as seen from each activity. These arc port names. Each activity refers to 
a port when sending a message. Butthis isi Lsown local name. In order to deliver 
messages from the appropriate pipe at the other end, they must arrive u’it.h the 
destination port name. Hence, port names of both ends must be exchanged between 
hosts during initial set up. ‘ • 

Pipes and ports are particularly useful when host activities are programmed with 
I - 0 sw eans left unnssigned to any specific device, and can be referred to by 
labels, say by port names. Using a command language, or some form of declarative 
statements allows a user to bind network and program port names at' execution time. 
Depending on his requirement!;, a user is able to use either local or distant files 
and 1-0 devices, just by assignment commands. (Fig. 13) 














r !'lio:;e functions arc: often associated whilst tl-.ey may appeal; of distinct nature. 

We .'.ball sec: why . I b.To r control 1 raia'ian d e tcc t ing the loss, or alteration, or 
undyc ,repotition of messages. But detecting errors only would not be of much 
avail without recovery. Thus a satisfactory error control mechanism should 
’ include a procedure to restart transmission in a proper way. Any recovery 
procedure assumes that the sender has kept copies of a certain number of past 
messages, Since they cannot be stored indefinitely, part of error control ■ 
consists in a. ' pfohedu're .whereby the receiver releases back-up copies of - received 
messages stored in the sender's space. All that boils down to a producer 
consumer process. The sender produces copies of messages, that arc gradually, 
consulted by the receiver, once it has excrc i sed _ i t s error detecting and recovery- 
'.capabilities. . . . ' 

Flow control is a procedure whereby the receiver allocates a potential, transmis¬ 
sion credit, to the sender ; no matter the form, used'to specify this credit. In 
other words the receiver produces empty cans gradually consumed by the sender, 
once successful transmission has occurred. 

In other words the semantics of error and flow control arc different; but the 
syntax can be the same. Thus it is common engineering practice to use the same 
mechanisms to implement both. • ’ 


To recap, discounting some idiosynchrasics, error and flow control are two 
producer-consumer procedures. The actual message transfer is a third one. 
Together they make-up -what we might call a rel inble produce r-con sumer communica 
tion. For a sequential pipe, the procedure . car. be reduced to 6 s t a t e v a r i a b les , 
■3 for the sender, 3 Tor the receiver. .They can be interpreted as pointers in an 
infinite linear message name space. If we adopt the following conventions : 

Fs Fr . . . . Flow’ control, send, receive 

Ts ’ , Tr .... Transmission control., send, receive 

Es , Er . . . . Error control, send, receive ■ , • 

these variables should meet the conditions : 

Es ^ Er Tr ^ Ts ^ Fs ^ Fr _ 

Thi s is a general iza tion of tine wel 1 knou T n producer-consumer scheme used in conven¬ 
tional computers, and often termed circular pointers. (Fig. 16) 


This scheme applies to non sequential transfer as well, with only 
in the interpretation of tile state variables. Instead of pointing 


a difference 
to message 


names, they can be understood as pointing 
with the condition that windows must slide, 
are managed 'individually. The window width 


to windows in the message name space, 
sequentially. -Within a window' messages 
can be variable, and. depends on 


resources available both in terms of name and storage space. This can be a 


-parameter .negotiated at pipe initial set up. As we can see. now, scauontial 
transfer is just a degenerated case of non sequential,-with window width exactly 


one.. 


•F - Event control 

Controlling message transfer is in effect controlling specific events to which 
'we attach the meaning : : 11 cssage allocated, message sent, message checked, etc . 
’but any other meaning would be acceptable as well, as far as control mechanisms 
are concerned. V.'c have an example in the. control of non sequential transfer, 
where the semantics "message window" have been substituted to "message". 
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.some ;><.> j.nl;; in l i me when several cl i i an l components mut all agree about l he fact 
that something did or did not: happen correctly. K • p, • transferring a tile, 
executing a job, updating a data base, etc... lloth alternatives arc. equally 
acceptable : either it did happen and all activities can go on, or it did not 
and they all have to go to a recovery procedure. The unacceptable situation is 
some activities deciding that it did, others deciding that it did not, or don’t 
knot;. This we may call a distributed event ; it has to be either true or false. 

Since there, cannot exist an ideal observer, event set tint requires propagation, 
'hence'del ay. Furthermore, communications components are unreliable. Consequently, 
the following situation can never be ruled out': "After all sorts of control, 

"an activity decides that an event is true, and updates its copy of the event. 
"Assuming that control, is .totally reliable, another activity decides also .that 
"the event is’true,' but'before updating the event, it fails". 

Then the event i.s "trulsc". A unique eve nt cannot be 'ascertained with more than 
h. certain probability. 

If: an event is seen false by some activity, due to failure, in the control 
mechanism e.g., a recovery procedure v;ill be entered by that activity, and the 
•others will be solicited again for an action that they considered finished. If 
the event was supposed to occur only once, these activities may conclude that it 
was "trulse" after-all, and go to recovery. But they may also have vanished under 
•the assumption that everything was ail right, and there is no longer- any way to. 
recover ■. .■■■■.) • 

On the other hand, if a series of repeatable events is expected, confusion may 
develop as to which instance is actually occurring, unless care is taken to make 
each event uniquely identifiable. For example, A opens a pipe to-B. It fails for 
‘A but succeeds for B, because an acknowledgment, got lost. A proceeds to try again, 
and B interprets that as opening a second pipe. . . 

It would seem .as though nothing could be ever certain in a distributed system. 

•In a strict sense this is correct, since no physical system can be held i00 % 
..reliable. But we used to term reliable a system whose failure rate is well below 
a tolerance level, whatever that may be. The point is that: some components in a 
computer network arc known to be unreliable by computer standards, specifically 
transmission lir.es. Subjectively one would be satisfied if a network were as 
reliable as a single computer system, or maybe somewhat better, to compensate for 
a-larger, complexity in recovery procedures. Since the pitfalls mentionned 
previously do not normally occur in a single computer, some appropriate procedures 
appear necessary in a network to keep them from happening. ■ 

A usual way for obtaining reliable service out of unreliable components is 
redundancy. Since a single distributed event cannot rate better than trulse, we 
introduce a prec edence rule as follows : . 

"■ if event E (n) is true then all events E (i), i<n, arc true". 

which can be condensed in the. form : 1C (n) r^> E (n-1). 

These we may call chained events. They stem naturally from the execution of 
sequentiaI or iterative processes. . ■ . 

The onqs now is to establish, that at least one event is true. The precedence 
rule, allows to do just that, as we shall see. 'But we have to assume that components 
are reliable enough, so that : 

. events cannot be "undone", once true they do not change, 

. there cannot be "ghost" event reports. 

Let F. (i) be. a distributed event in a series of chained, events, with local 
components ^ 1L (i) J in the domains of a distributed activity A - j A^ J . 



W \ ’. 



cmbelld lug A, to v.'hich E (1 ;i r; t;) would bo. reported. Actually this makes E (last) 

, 'belong L'o the. controlling environment rather than to the cii stributed activity A. 

Thereafter this environment could use whatever: ad hoc technique suitable to the 
-• problem at hand, like keeping track of E. (last) reports-in local A. environments 
y for as long as necessary. This may work ifter nil, but we did not Actually solve 
the' problem, "we only threw' it in someone clsc's hand. Practically the controlling- 
environment is nothing but a-distributed activity, for which E (last) can be- 
' just one event in a chained set,- and thus, ascertained by subsequent occurrences. 

In the- end we have to assume a global network, environment which will . never 
'■ terminate, its execu t ipn. For all practical- purposes, this may be satisfactory, 
but it'still leaves a,mixed feeling that a distributed activity be unable to 
insure its normal termination. 


Going back to our synchronization scheme, we can take a different, approach. Let 

. E (n) be the last event in A marking off the end of the useful execution. We 

introduce two more final events and two more sync operations through v.'hich- each 
A. must step before normal termination. Should they all succeed, one may say ! 

' tl'iat it were useless, because it .did not add anything to what each'A. could tell 
after E (n) . But this is different if some cf them fail . The cl i ] emrna^ f or an A. : 

. goes like this : "1 know I'm finished. I know you're finished. But do you knovl 
I'am, so I can go home". ' • j 

According tc the synchronization logic, we may state that any A. having success-; 

- fully executed sync (n) may conclude that the activity A has been safely termi- 
naked. In ease of failure on sync (n + 1) .it should attempt recovery, because it 
may unblock some A^_ latched on sync (n). If recovery Joes not succeed, or if sync 
: (ii -i- 2) fails, A-. can nevertheless go home safely. In other .words, failures of 

H (n + 1) or E (i\ + 2) do not cause A to fail. j 

- Failure to pass sync (n) , ■ for some A., is an unsafe termination'. If recovery docs 
. not succeed, it may be that terminating A is impossible without external inter- : 
vention. It would be the same tiling for any failure prior to n. In this case, 
trouble reports must be directed to a controlling environment for further ; 

analysis and recovery. Thus one still has to resort to'a controlling environment, 
'as in any conventional system, but its role is limited to 'creep t i ona 1. cond i t ions , 
as it should be. 

G - Time-outs _ ■ t 

As we. have seen abundantly, due to the potential failure of some components, a ! 

■ distributed activity cannot rely upon well behaved processes. This is also true 

for any large scale and complex system, in which logical flaws cannot be complo.- 1 
tcly eliminated. Since component: activities are dependent on the correct > 

propagation of various, information, they must always be in a position to escape 
f rom d e ad lock: if the expected information does not arrive. Regardless of the 

■ implementation (watchdog, loop, manual intervention), it boils down to some time 
delay beyond v.'hich an activity is forced to continue. What -is appropriate to do 

' is of course peculiar to each situation. ' • . ... I 


•A time-out. may be thought of 'a ni 1 cvont which always occurs in lieu of an 
expected one. But it carries no reliable information, only doubt.- Indeed, if : 

delays had to be set so there would be no significant probability to observe ! 

'•hat was expected, they would often be too long and deteriorate efficiency. On 1 
the other hand, if they are too short, exceptional conditions would be triggered 
too often and again increase overhead. Consequently, a first property of a time¬ 
out delay is to be.-_hmed ■ i n relation to a particular environment. It does not. mean 
that the expected event did not or will never occur. 1 







Typically n ■ t:) me-on t triggers some d i a c.nos. i i r s nr 
'ti.mcd~out event' iwy have occurred already, or c.uv 
'netions started in Clint context must be arranged 
they arc reduntl an t: . 


r e cov e r v procedure, But Lhc 
be under r;iy, Con r. C'(]ue n L 1 y , 
:;o that Lhc.y do no harm when 


.Usually time-outs are placed in several components cooperating asynchronously. 
'This results in t: i me dependent; i e.s requiring a thorough analysis. As in feedback 
systems, oscillations, and vicious loops can kill normal behavior. Unfortunately 
this , is an area where we lack a systematic approach. Constructions must be 
'Validated by’hand, or computer simulation, and only simp.re ones lend themselves 
to. practical analysis. 

A’very restricted.example, appears on Fig. 17, -which represents a sender and a 
receiver automaton, ui.th some suggested time dependencies.. As an exercise 
readers wi11 likely find that they would pick different ones. The reason' is 
that one can make quite different assumptions about the operating environment. 
It may also happen that the environment is unstable. Conclusion : time-outs are 
a tangled issue. 


H - Mult i- level erro r control • 

As seen previously, a.distributed activity, as any other, needs a control1ing 
environment 'to which it can report unrecoverable or doubtful situations. 
Furthermore, each component is necessarily restricted to a domain in which some 
types of errors cannot be detected, beca.use it would require access to extraneous 
..information not relevant to its activity. K.g. the communications network cannot 
tell whether a message is a correct command for an ItJE service, (remote job 
entry). Therefore control must be distributed across several levels of environ¬ 
ment, starting from inner level components (transmission lines), through logical 
components of the communications network, host protocols, user activities, 
network operating system. 

Since control means cost, or overhead, the objective is to make it cost-effective 
In other words it should be implemented where it is most efficient, and it 
should not be redundant without serious justifications. Consequently, a logical 
approach consists in specializing components in some types of control which they 
can perform well. Errors Lhat are detected but cannot be corrected with enough 
■reliability should be reported to the outer layer, while inner layers should be 
trusted for whatever control they arc in charge of. 

When propagating information, a first type, of control is -to make sure that bj.t 
patterns are not corrupted. This is typically the sort of function which a 
hardware logic using cyclical redundancy checking (CMC) .can do efficiently with 
high reliability. On the oLher hand, other methods are more expensive. Thus, 
bit control is' to be entrusted to 1-0 adapters. But they usually do not correct 
errors, because it requires some, programmed logic. This second level of control 
is_ devoted to Lhc 1-0 adapter environment, i.c. a transmission procedure, which 
corrects errors by repeating corrupted messages. ; 

At a further level, mes sa ges may be assumed correct: as far as bit patterns are. 
concerned. But due to the parallel and adaptive structure of the. communications 
network, some messages may be lost or duplicated. Another level of control is 
thus required, It may be located within the. communications network, but since 
it'requires some form of end to end feedback, messages must be stored, identified 
acknowledged, and the. corresponding machinery appears far too involved-if 
messages can flow out of the communications network to a host through several 
nodes, (this war, one. of our network characteristics).- 
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m o f me a go con i r o 1 , 
no r es.i i. y if host: implements 1i on:; and message transfer were 
mo: com'maa i ca t: ions network control cannot: extend -up to 
•n;ul *;of twsrc, there appear;; a pap in message. control which 
i!vip] i oat: ion of function, hut one might arpuc that mess a pc 
he located at host level, because it: is necessary anyway, 
all inner controls at a marginal cost. However, some message 
mission lines 'may reduce ' error coiTf.LVi.en by hos t s , • bu t ' i t-- 
1 1 v 1 d r e 1 i a b 1 e . 


For some tvues n f :an 1 ica t: ions (data pipes) messages must be delivered in a 
correct: sequent'-' . Again, this impli.es m essage co ntrol. On the other hand 
sequential deJ iv. ;y to a user does not imply sequential delivery to a host. 
Reordering can 1 done by the receiver protocol, together with message control, 
.This is further re.,son to put message control at host level. 

More and more 1 <:■ \. ■ 1 s could be examined. They would take.us into specific functions 
such as term): 1 control, file handling, etc ... Perhaps there is already 
sufficient to leave it up to reader investigation. 
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■miction in the context of computer'networks is the breaking 
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: other hand original- messages must be 
ion activity. This is called reassembly. 


i on a 2-char, control message, a 30-char, transaction, a 
■, and a 30 Mchar. file, there cannot be any satisfactory 
1 megl:h , liven if packets can accomodate a few hundreds of 
■ill not cover 100 % of eases. ; 
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storage and prevent deadloc 


Control mechanisms are 
between several messages. 


. i.mum message length is still too small for built data 
■r level-of fragmentation is required at host level.. 
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a to do dll fragmentation at host level and have the com.munica- 
y just packets. Unquestionably this reduces significantly the 
wage, transfer, but it may increase the overhead associated 
Home blocking scheme, may allow 1-0 to take place for a - bunch 
they were separated in time. Chained 1-0 channel control words 
late that shortcut. Another ..way is to make network 1-0 
ig dedicated interrupts and software,' or a front end processor 
my access. Indeed 1-0 overhead is by far an operating system 
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Congem tion 


lie use this term lo mean a pr.thologi cal situation when a communica tions network 
is swamped with nrssages which cannot find their way out. It can be. a 1 oc.nl 
congestion due to a broken link or a dead host, or n total congestion clue to an 
excess of accepted messages. In many respects ibis can be. compared to automobile 
'traffic jams. This is presently a subject on which intensive research is pursued, 
Mmw. rn.,,'1 •) 1 i v ,.p ivuur 1 : are v p c o mme ml c d to get a thorough treatment. 
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V - ' FINAL 


These notes have no . a mb 11 ion to be cxh'aus t ivc ■ or even consistent. Like the 
subject-, it is distributed and open-ended discourse, about what computer, 
networks are, or could be, in our instant fuzzy state of mind. Since they nudge 
at conventional veil established structures, they are controversial, and in 
'this domain one should pay a blink at the author's personal bias. 


Besides the obvious facility of giving a large number of users access to a 
large number of computers, considerable work is yet to accomplish before 
networks can be made useful on a casual way. The idea of a general, purpose 
heterogeneous computer network may turn cut a chimera at least with the present 
and 'next to come generation of computer systems. But it can be highly successful 
•.for selected a "plications, for'which the technology is nevertheless needed. . 

Network structures are already forcing us into new visions of tools and concepts 
some of which were, reaching at religious statute. Ue will have to learn how to 
, integrate uncertainty and parallelism in our thinking and our languages, 
i, Communications arc the next challenge in commuter structures. 









